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BACKGROUND OF THE INVENTION 

5 

1 . Field of the Invention 

The present invention relates to a method for acquiring fingerprints by a linear 
fingerprint detecting sensor, and more particularly, to a method for acquiring 
fingerprints by a linear fingerprint detecting sensor by which a fingerprint image 
10 captured by the linear sensor is acquired by the estimation and restoration of the 
fingerprint image. 

2. Description of the Related Art 

As is generally known, fingerprints have been recently adapted to many fields 
15 since the modem fingerprinting method was established by Edward R. Henry. 
Particularly, fingerprints are widely used as strong personal authentication means in the 
fields of pay, personnel, banking, criminal investigation, security, etc. 

A personal authentication process using fingerprints largely * includes a 
classification procedure for classifying a wide variety of fingerprints by shapes and a 
20 matching procedure for identifying a person. 

At this time, prior to the classification of fingerprints by shapes, a fingerprint 
image is captured, and then it is checked whether the fingerprint image is a registered 
image, for thereby authenticating the fingerprint. 

In case of using a linear sensor as a method for recognizing fingerprints in the 
25 prior art, a plurality of image strips are captured, and thus a method for combining 




captured image strips is required. 

The US. Patent No. 6,002,815 discloses a method for combining image 
segments. The image combining method is a method for restoring the fiill image using a 
series of image strips acquired by the Unear sensor by vertically compensating for the 
5 difference of movement speeds of a finger, an object. 

However, the image restoration method disclosed in the US. Patent No. 
6,002,815 also has a problem that it cannot suggest a method for compensating for a 
pressure difference for a sensor of a finger and horizontal and rotational directions. 

1 0 SUMMARY OF THE INVENTION 

It is, therefore, an object of the present invention to provide a method for 
acquiring fingerprints by a linear fingerprint detecting sensor capable of restoring a 
precise fingerprint image by dividing a fingerprint image into a plurality of regions, 
estimating the optimum matching point of each divided region and compensating for the 

1 5 fingerprint image deformed based on the matching point. 

In order to achieve the above-described object of the present invention, there is a 
method for acquiring fingerprint by using a linear fingerprint detecting sensor 
comprising the steps of: capturing a fingerprint image sequentially through the 
fingerprint detecting sensor; dividing scanned fingerprint image as a predetermined 

20 segments according to a constant time and speed; detecting the optimum overlap region 
by comparing each image strip and its segment with the next image strip; calculating the 
value of mean image variation through the overlap region; and mixing the entire image 
by applying the mean image variation value to each image strip. 

Preferably, the captured fingerprint image is divided a plurality of segments in 

25 which the width of each segments is the same as the height of each image strip. 



Preferably, the step of calculating the image variation value further comprises 
the steps of: comparing a single image strip with the next image strip; and estimating a 
vertical movement value of the fingerprint image. 

Preferably, the step of calculating the image variation value further comprises 
the steps of: comparing a segment of a single image strip with a segment of the next 
image strip; and estimating a horizontal variation value by using an overlap region. 

Preferably, the overlap rate of each image strip is above 50% because each 
parameter has a limitation value as follows; 



10 Preferably, in the step of capturing the fingerprint image, the capturing rate 

according to the speed of movement of fingerprint is controlled by using the following 

speed change formula applied the limitation value of each parameter, where the formula, 

IvAy. 2Mv,Ax, IMvAa, 

Vj^i=max( , '—^ , ^ ). 

^ M N N 

Preferably, a degree of inclination to the image variation is calculated by using 
15 the following formula under the superposed fingerprint image, where the formula, 

tan(Aa) = 



M*tan(a^) 



A^ + M*tan(aJ 

Preferably, the step of mixing the entire image further comprises the steps of: 
summing the variation value of local coordinates (horizontal, vertical, degree of 
inclination) from the referenced image strip through the following formulas; and 
20 estimating a global coordinate, where the formulas, 
Ai+i=Ai+Aa 

Xi+i=Xi+Axcos(Ai+i) - Aysin(Ai+i) 
Yi+i=Yi+Axsin(Ai+i) - Aycos(Ai+i). 




BRIEF DESCRIPTION OF THE DRAWINGS 

The above objects, features and advantages of the present invention will 
become more apparent from the following detailed description when taken in 
conjunction with the accompanying drawings, in which: 
5 Figure 1 is a flow chart schematically illustrating a method for acquiring 

fingerprints by a linear detecting sensor in accordance with a first embodiment of the 
present invention; 

Figure 2 is a flow chart illustrating a method for constituting an acquired 
fingerprint image by a linear fingerprint detecting sensor in accordance with the first 
10 embodiment of the present invention; 

Figure 3 is a view illustrating a sensing region sensed by the linear detecting 
sensor in accordance with the present invention; 

Figure 4 is a view illustrating a variable value of an image strip; 

Figure 5 is a view illustrating a sensing region divided into particular strips; 
1 5 Figures 6a and 6b are views illustrating a degree of inclination according to the 

movement of an image strip; 

Figure 7 is a view illustrating a resultant value according to an approximate 
fimction according to Figures 6a and 6b; 

Figures 8a through 8e are views illustrating types of fingerprint variable values; 
20 Figures 9a through 9e are views illustrating a sensed state according to the 

types of fingerprint variable values; 

Figures 10, 11a and lib are state diagrams illustrating an image restoration 
state by a fingerprint recognition system in accordance with the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
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A preferred embodiment of the present invention will now be described with 
reference to the accompanying drawings. 

Figure 1 is a flow chart schematically illustrating a method for acquiring 
fingerprints by a linear detecting sensor in accordance with a first embodiment of the 
5 present invention. 

Hereinafter, the method for acquiring fingerprints by a linear fingerprint 
detecting sensor in accordance with the present invention will now be described in 
detail with reference to the accompanying drawings. 

Figure 2 is a flow chart illustrating a method for constituting an acquired 
10 fingerprint image by a linear fingerprint detecting sensor in accordance with the first 
embodiment of the present invention. 

Figure 3 is a view illustrating a sensing region sensed by the linear detecting 
sensor in accordance with the present invention. Figure 4 is a view illustrating a variable 
value of an image strip. Figure 5 is a view illustrating a sensing region divided into 
15 particular strips. Figures 6a and 6b are views illustrating a degree of inclination 
according to the movement of an image strip. Figure 7 is a view illustrating a resultant 
value according to an approximate fimction according to Figures 6a and 6b. 

Firstly, the fingerprint detecting sensor generates continuous image strips, and 
estimates a variable value between the strips by using an overlap region between two 
20 sequential strips. Each strip has at least two rows consisting of discrete points and pixels. 
With the image strips acquired by the sensor, the distance between the strips is 
estimated and the image strips are combined to produce a composite image. 

As soon as the user contacts his or her finger to the fingerprint detecting sensor, 
scanning and image restoration are initiated in ST-210. 
25 At this time, the fingerprint detecting sensor scans a fingerprint image 




according to a constant time and speed in ST-220. 

More specifically, assuming that the movement direction of the finger, which is 
an object moving on the upper surface of the fingerprint detecting sensor, and the 
pressure apphed on the fingerprint detecting sensor by the finger are different fi-om each 
5 other, a produced image is affected by the movement characteristic of the finger. 

Therefore, in the method for acquiring fingerprints of the present invention, 
sequentially acquired image strips are captured so that they can be combined, and a set 
of coordinate variables (x, y coordinates) for each image is generated. 

In the present invention, when each image segment i s combined to be generated 
10 as the full image, the coordinate set provides the accurate position of the corresponding 
image strip. In addition, in the method for acquiring fingerprints of the present invention, 
added information about the combination of fingerprint images, such as the start and 
end position of an image, the loss state of synchronization, etc. are acquired and the 
adaptive capturing rate is calculated and produced by the movement amount of each 
15 image strip. 

For this purpose, in the method for acquiring fingerprints according to the 
present invention, (x, y, a) is used for the local coordinate system between two adjacent 
strips of a captured fingerprint image, and (X,Y,Z) is used for the global coordinate 
system for the fixll image. The coordinate difference of the local coordinate system is 
20 represented as (Ax, Ay, Aa). 

At this time, a sensor region consists of N columns and M rows as illustrated in 
Figure 3. Since the sensor is a linear sensor, it is assumed that N>M^. The image strips 
acquired by this sensor has the same size as the sensor region. 

That is, the method for acquiring an image by the combination of images 
25 according to the present invention includes a series of processes for acquiring image 



strips. In order to estimate the movement amount of an image according to a movement 

value of the relative coordinate, as illustrated in Figure 4, the central movement amount 

of the image strips and the rotational movement value thereof are calculated by 

comparison of the image strips. 
5 At this time, in order to compare a plurality of image strips, it is necessary that 

an overlap region where the image strips are overlapped is present. Thus, the capturing 

rate of the fingerprint detecting sensor is controlled according to the speed change of the 

finger so that the image strips are overlapped with one another. 

Strips Sj and Sj+1 are captured at speed Vj at time tj and tj+i in ST-230. 
10 That is, as illustrated in Figure 5, the image strip is divided into M segments 

which is the same as the height (for example, M) of each image strip in order to detect 

the horizontal variable value of the image strip. 

Then, based on the segment of the first image strip SI of all the image strips, 

the optimum overlap region in the segment region of the next image strip S2 is detected 
15 inST-240. 

In addition, a degree of vertical/horizontal deformation is estimated by the 
angle of rotation or deformation between the first image strip SI and the next image 
strip S2, and simultaneously the mean weight value is given to each variable value, for 
thereby combining the image strips. That is, Axji and Ayjj are calculated based on the 
20 optimum matching point, and Axj, Ayj and Aaj of Sj+i are obtained by the mean squire 
linear approximation with a weighting factor in ST-250. 

In other words, as illustrated in Figure 5, the image is captured so that a 

plurality of image strips having M segments can be formed, the overlap region of the 

image strips is adapted to calculate a vertical displacement value, and the segments 

25 divided firom each image strip are compared to calculate a horizontal displacement 
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value. 

By this, as illustrated in Figures 6a and 6b, the overlap regions of the image 
strips forms an approximate value in the global coordinate system. Local(x,y) 
movement values Axn and Ayn indicate the position of the minimum value of the 
5 differential function of the corresponding segment. The mean squire linear 
approximation with a weighting value is used to estimate sloping side Aa, tangential 
displacement Ay and parallel displacement Ax. 

At this time, as illustrated in Figures 6a and 6b, isometric approximation is 
adapted to acquire a degree of inclination of AXn=Ax(n) and Ayn=Ay(n) and Ax and Ay. 
10 The displacement of Ax and Ay is acquired by the approximate function value at the 
center of the first image strip. 

Therefore, when the overlap region is estimated fi*om the image strip divided 
into a plurality of segments which is captured as the finger moves, as illustrated in 
Figure 7, the image displacement is represented which is the same as the displacement 
15 of each segment with a constant sloping side. 

The degree of inclination for the image displacement of the segment will be 
expressed by mathematical formula 1 . 

[Mathematical Formula 1] 

tan(Aa) = 



*tan(a^) 



// + M*tan(aJ 

20 When Y(n) = y(n) in Figure 6a and X(n) = — * « + x{n) in Figure 6b and the 

M 

two formulas are differentiated for n, Mathematical Formula 1 can be represented as 

— = — = t^n(dy) and — = — + — = — + tsin{dx) . 
dn dn dn M dn M 

As illustrated in Figure 7, three parameters for the movement amount of 

fingerprints are presented between segments of a plurality of overlapped image strips. 

8 



Those parameters includes tangent line, parallel displacement amount and angle of 
rotation. By using the thusly calculated parameter set in the local coordinate system, the 
image strips are compared with one another, and then are combined in the global 
coordinate system, for thereby acquiring a complete image. 
5 That is, strips Si+1 (local coordinate) are accumulated in the appropriate 

position of the full image buffer(global coordinate system) by using Axj, Ayj and Aaj in 
ST-260. When the buffering is completed, the corresponding full image is stored in ST- 
270. 

At this time, it is judged whether scanning is completed in ST-280. 
10 If the scanning is not completed, it is necessary to control the capturing rate 

according to the change of the movement speed of the finger so that certain regions of 
the image strips are overlapped. To change the capturing rate, at least one of the 
coordinate parameters has to be spaced as long as a predetermined marginal value. 
[Mathematical Formula 2] 



The marginal value of each parameter described in Mathematical Formula 2 is 
adapted so that approximately 50% of the image strips can be overlapped with one 
another. At this time, the capturing rate Vj+i of the sensor can be calculated by analogy of 
Mathematical Formula 2. 

M 

20 That is, assuming that Ayi+i converges to — , when Avi x Ayi - const and Avj+i 

X Ayi+i - const, the displacement of y of vi+1 (vi+1 = ) can be calculated. 

M 

Likewise, if x and a are calculated in the same marmer, the following capturing rate is 
obtained. 

[Mathematical Formula 3] 





Vj+i=max( 



2vj Ay J 2Mvj Axj 2Mvj Auj 



M ' N ' N 



In the present invention, Mathematical Formula 3 is adapted to the step ST-220 
for capturing a fingerprint image for thereby controlling the capturing rate in ST-290. 

Figures 8a through 8e are views illustrating types of fingerprint variable values. 
5 Figures 9a through 9e are views illustrating a sensed state according to the types of 
fingerprint variable values. 

Referring to this, the fingerprint image shows a variety of types according to a 
variable value for each movement as illustrated in Figures 8a through 8e. The value of 
the corresponding parameter is different according to each of the types. For example, 
10 Figure 8 illustrates a vertical parallel displacement by which the x coordinate movement 
and rotation of the finger is not made, x and a indicate 0. 

Moreover, Figure 8b illustrates the case where the movement direction of the 
sensor and the finger is not orthogonal but has a lateral movement component Ax. 
Figure 8c illustrates the combination of vertical movement and rotation. Figure 8d is 



15 similar to Figure 8c excepting that horizontal movement is made on the image 
coordinate AX by a rotation difference at the central position. In Figure 8e, it is 
impossible to produce the composite image since all portions of the finger are deviated 
fi:om the sensing region. 



20 on the global image coordinate, the global coordinate(image coordinate) is performed 
on the local coordinate(coordinate of the sensor) by a recursive procedure such as the 
following formula. 



At this time, since X, Y and A fully define the position of the current image strip 



[Mathematical Formula 4] 



Ai+i=Ai+Aa 



# 



Xi+i=Xi+Axcos(Ai+i) - Aysin(Ai+i) 
Yi+i=Yi+Axsin(Ai+i) - Aycos(Ai+i) 

That is, as expressed in Mathematical Formula 4, Ai+i, X\+\ and Yi+i can 
calculate the global coordinate and produce the composite image by summing the 
5 parameters Aj, Xi and Yj of the previous image strip and variable values thereof. 

Figures 10, Ua and lib are state diagrams illustrating an image restoration 
state by a fingerprint recognition system in accordance with the present invention. 

Referring to this, Figure 10 illustrates a view of capturing a fingerprint image 
deformed in a horizontal or vertical direction by applying a pressure on the fingerprint 
10 detecting sensor. The fingerprint recognition system of the present invention restores a 
scanned fingerprint image by image estimation and restoration algorithm as illustrated 
in Figure 8. 

At this time, in the present invention, as shown in Figure 11 a, the scaimed 
image is divided into multistage image strips and then the values of the rotation of the 

15 image strips and the image deformation are calculated by comparing one image strip 
with the next image strip based on the overlap region of the image strips. Based on the 
calculated values, the original image is restored as illustrated in Figure 1 lb. 

Meanwhile, the method for acquiring fingerprints by a linear fingerprint 
detecting sensor in accordance with the present invention can be used as a method for 

20 identifying a user for access control or prior to the driving of a PC or as means for 
identifying a user of a mobile phone. That is, this method can be used widely as a 
method for accurately identifying a user of various personal electronic equipment, and 
can be adapted to every methods for improving correct recognition rate for fingerprint 
recognition including criminal investigation. 

25 While the invention has been shown and described with reference to certain 



preferred embodiments thereof, it will be understood by those skilled in the art that 
various changes in form and details may be made therein without departing from the 
spirit and scope of the invention as defined by the appended claims. 

As seen from above, the method for acquiring fingerprints by a linear 
fingerprint detecting sensor in accordance with the present invention can improve the 
correct recognition rate greatly by estimating and compensating for the scanned image 
by the fingerprint detecting sensor and accurately restoring the same to the original 
image. 
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